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AMENDMENTS TO THE CLAIMS 



1 (Currently Amended) A method for stabilizing an image of an object being 
taken from a video camera, the video camera being moved by a transport mechanism 
and being controlled by a line-of-sight controller, the line-of-siqht controller having an 
orientation and an angular velocity, the method comprising- 
receiving a plurality of images of the object; and 
for each of the plurality of received images, 

receiving a distance from the video camera to the object^ 
determining a difference between the location of the object within the 
image and the location of the object within a previously captured 
images 

calculating an inter-frame stabilization adjustment based on the distance 
to the object and the difference between the location of the object 
within the image and the location of the object within a previously 
captured image, the inter-frame stabilization adjustment for 
adjusting the position of a displayed area of-an the received 
images^ 

adjusting the position of a- the displayed area of the received images 
based on the inter-frame stabilization adjustment, wherein the 
received images is- are larger than the displayed image display area 
and the adjusting of the disp l ay of tho image moves-an the display 
area of tho displayed i mag o within-relative to the received images^ 
and 

calculating a lin e of sight adjustment for tho lino of sight-controller based 
on the inter frame stab i lization adjustment; and 

controlling the line-of-sight controller at least in part bv.-in accordance with 
the calculated lino of sight adjustmont 
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calculating a line-of-siqht adjustment for the line-of-sight controller 

based on the inter-frame stabilization adjustment, 
adjusting the orientation of the line-of-siaht controller based on the 

calculated line-of-sight adjustment, 
calculating an angular velocity for the line-of-siqht controller based 

on the inter-frame stabilization adjustment, and 
setting the angular velocity of the line-of-sight controller to the 

calculated angular velocity. 

2. (Original) The method of claim 1 wherein the transport mechanism is an 
airborne vehicle. 

3. (Currently Amended) The method of claim 1 wherein the line of sight of 
the video camera is derived from the line-of-sight controller. 

4-5. (Cancelled) 

6. (Previously Presented) The method of claim 1 wherein the inter-frame 
stabilization adjustment specifies the number of pixels in scan and tilt directions. 

7 (Original) The method of claim 1 wherein the controlling of the line-of- 
sight controller specifies rate of scan and tilt movement. 

8. (Original) The method of claim 1 wherein the distance to the object is 
provided by a range finder. 

9. (Currently Amended) The method of claim 1 wherein the distance to the 
object is calculated based on the line of sight of the video camera and the difference in 
altitude of the object and the video camera. 
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10. (Original) The method of claim 1 wherein the velocity of the transport 
mechanism is relative to the object. 

1 1 . (Original) The method of claim 1 wherein the velocity of the transport 
mechanism is relative to an earth frame of reference. 

12. (Original) The method of claim 1 wherein the calculated inter-frame 
stabilization adjustment factors in field of view of the display. 

13. (Currently Amended) A method for stabilizing an image of an object being 
taken from a video camera, the video camera being moved by a transport mechanism 
and being controlled by a line-of-sight controller, the line-of-sight controller having an 
orientation and a pan rate, the image being displayed on a display device, the method 
comprising: 

determining a difference in the location of the object within the image from one 

frame to the next frame; 
calculating an inter frame stabilization adjustment based on th o dete rm ined 

difference; 

adjusting the display of the image based on the inter frame stabilization 
adw&tment- determined difference to remove small-amplitude jitter; and 

calculating a line of sight adjustment for-the line of sight controller based on the 
inter frame-stabilization adjustment to account for l a rgo- a mpfityde-jitte^ 

controlling the line-of-sight controller i n accordance w ith 4he-e a leu f a t e d lin e of 
sight adjustment by. 

calculating a line-of-sight adjustment for the line-of-sight controller based 
at least in part on the determined difference. 
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adjusting the orientation of the line-of-siqht controller based on the 
calculated line-of-siaht adjustment to account for large-amplitude 
jitter- 
calculating a pan rate for the line-of-siqht controller based at least in part 

on the determined difference, and 
setting the pan rate of the line-of-siqht controller to the calculated pan rate. 

14. (Original) The method of claim 13 wherein the determining of the 
difference includes analyzing scan and tilt rate of the line-of-sight controller. 

15. (Original) The method of claim 13 wherein the determining of the 
difference includes analyzing velocity of the transport mechanism 

16. (Currently Amended) The method of claim 13 wherein the determining of 
the difference includes analyzing line of sight of the video camera. 

17. (Currently Amended) The method of claim 13 wherein the determining of 
the difference includes analyzing orientation of the video camera and the transport 
mechanism. 

18. (Original) The method of claim 13 wherein the determining of the 
difference includes recognizing the object within the images. 

19-26. (Cancelled) 

27. (Previously Presented) An apparatus for stabilizing imagery from an 
airborne video camera displayed on a display device, comprising: 

a mechanical line-of-sight controller for controlling line of sight of the video 
camera at a specified line-of-sight adjustment rate; and 
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an electronic stabilization component that provides frame-to-frame image 
stabilization based on a change in location of an object within the images 
by adjusting the display of the images to remove small-amplitude jitter and 
that provides to the mechanical line-of-sight controller a new line-of-sight 
adjustment rate derived from the change in location of an object within the 
images to account for large-amplitude jitter. 

28. (Currently Amended) The apparatus of claim 27 wherein an amount of 
frame-to-frame image stabilization is additionally based on velocity and orientation of an 
airborne transport vehicle, orientation of the video camera relative to the airborne 
transport vehicle, and distance from the video camera to the object within the image. 

29. (Previously Presented) The apparatus of claim 27 wherein an amount of 
frame-to-frame image stabilization is additionally based on the specified line-of-sight 
adjustment rate. 

30. (Original) The apparatus of claim 27 wherein the line-of-sight adjustment 
rate includes a scan rate and a tilt rate. 

31 (Original) The apparatus of claim 27 wherein an image received from the 
video camera is larger than a displayed image and the electronic stabilization 
component provides frame-to-frame image stabilization by adjusting the location of the 
displayed image within a received image. 

32. (Original) The apparatus of claim 27 wherein the specified line-of-sight 
adjustment rate includes a user-specified image flow. 

33. (Original) The apparatus of claim 27 wherein the mechanical line-of-sight 
controller is a motorized gimbal system. 
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34. (Original) The apparatus of claim 27 wherein the frame-to-frame 
adjustment keeps the object of the images at the same location when displayed. 

35. (Currently Amended) A method for stabilizing images being taken from a 
video camera mounted on a moving vehicle, the video camera having a line of sight 
being controlled by a line-of-sight controller, the line-of-siqht controller having an 
orientation and a rate of rotation, the method comprising: 

calculating initial coordinates for a viewport, the viewport corresponding to a 

portion of an image that is to be displayed; 
calculating inter-frame stabilization adjustments based on the change in location 

of an object in a succession of image frames to account for a_velocity of 

the vehicle, the inter-frame stabilization adjustments used to electronically 

move the viewport from one frame to the next frame; 
moving the viewport in accordance with the calculated inter-frame stabilization 

adjustments so that the viewport does not remain centered relative to the 

images taken from the video camera ; 
displaying a portion of an image corresponding to the moved viewport; and 
calculating lino of sight adjustments for the- line of sight controller based on tho 

in ter-frame stabilization adjustments; and 
controlling the line-of-sight controller-4n-asGefdance with the calculated line of 

sight adjustments at least in part by, 

calculating a line-of-siqht adjustment for the line-of-sight controller based 

on the inter-frame stabilization adjustments, 
adjusting the orientation of the line-of-sight controller in accordance with 

the calculated line-of-sight adjustment- 
calculating a rate of rotation for the line-of-sight controller based on the 

inter-frame stabilization adjustments, and 
setting the rate of rotation of the line-of-sight controller to the calculated 

rate of rotation. 
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36. (Original) The method of claim 35 wherein the calculating of the inter- 
frame stabilization adjustments factors in scan and tilt rate of the line-of-sight controller. 

37. (Currently Amended) The method of claim 35 wherein the calculating of 
the inter-frame stabilization adjustments factors in line of sight of the video camera. 

38. (Currently Amended) The method of claim 35 wherein the calculating of 
the inter-frame stabilization adjustments factors in orientation of the video camera and 
the vehicle. 

39. (Original) The method of claim 35 wherein the calculating of the inter- 
frame stabilization adjustments includes recognizing an object within the images. 

40. (Original) The method of claim 35 wherein the calculated line-of-sight 
adjustment specifies a scan and tilt rate for the line-of-sight controller. 

41. (Currently Amended) A method in a camera stabilization system for 
stabilizing the display of images received from a video camera attached to an aircraft 
and controlled by a gimbal-based line-of-sight controller, the method comprising: 

receiving a first image from the video camera; 

receiving a second image from the video camera; 

determining the position of an object in the first image; 

determining the position of the object in the second image; 

determining an image pixel offset in the scan direction, IPO(S), based on the 

difference in the position of the object in the first and second images; 
determining an image pixel offset in the tilt direction, IPO(T), based on the 

difference in the position of the object in the first and second images; 
determining a pixel offset in the scan direction, PO(S), based on IPO(S); 
determining a pixel offset in the tilt direction, PO(T). based on IPO(T); 
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adjusting the display of an image on a display device of the camera stabilization 

system based on PO(S) and PO(T); 
converting PO(S) to a corresponding scan angle based on the field of view of the 

video camera: 

converting PO(T) to a corresponding tilt angle based on the field of view of the 
video camera; 

adjusting a scan rate of the line-of-siqht controller based on the scan angle: and 
adjusting- th e v el o city a tilt rate of the line-of-sight controller based on the scan 

angle and the tilt angle 
so that both the display of the image and the line— of— sight controller are adjusted 

based on IPO(S) and IPO(T). 



42. (Currently Amended) The method of claim 41 , further comprising, 
determining aircraft pixel offsets caused by the movement of the aircraft by, 

receiving an indication of the velocity of the aircraft in the earth reference 
frame, V* rcraft , 

receiving a matrix, C BE , corresponding to the orientation of the aircraft in 

the earth reference frame, 
receiving a matrix, C C b, corresponding to the orientation of the video 

camera, 

calculating a transformation matrix, C C e, for transforming ferre-from the 
earth reference frame to the camera reference frame, wherein 
Cce = CcbCbe, 

calculating a line of sight, L E of the video camera in the earth reference 

frame, wherein L e =C C e t (1 ,0,0) t 
determining the distance, K, to an object at the center of the image, 
determining the velocity of the aircraft in the camera reference frame, 

YLaft, wherein =C CE * V* craft , 
calculating a normalized velocity of the aircraft V a c ? rcraft = V^/K, 
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calculating a first difference in scan units ASf, wherein 
AS^ = VL aft (S)*AT, wherein (S) corresponds to the 

normalized velocity of the aircraft in the scan direction, and wherein 
AT corresponds to a frame refresh period, 
calculating a first difference in tilt units ATf, wherein ATf = V|j rcraft (T)* AT , 
wherein (T) corresponds to the normalized velocity of the 

aircraft in the tilt direction, 
calculating an aircraft pixel offset in the scan direction APO(S), wherein 
APO(S)= ASf * P/Z, wherein P corresponds to a pixel density 
associated with the video camera, and wherein Z corresponds to a 
zoom factor associated with the video camera, 
calculating an aircraft pixel offset in the tilt direction APO(T), wherein 
APO(T)=AT 1 c *P/Z 
wherein PO(S) is determined based on IPO(S) and APO(S), and 
wherein PO(T) is determined based on IPO(T) and APO(T). 

43. (Currently Amended) The method of claim 42, further comprising: 
determining camera pixel offsets caused by the rotation of the video camera by, 

receiving the instantaneous camera scan rate IS, 

receiving the instantaneous camera tilt rate IT, 

calculating a second difference in scan units, AS 2 , wherein AS 2 =IS* AT , 
calculating a second difference in tilt units, AT 2 C , wherein AT 2 c =IT*aT , 
calculating a camera pixel offset in the scan direction, CPO(S), based on 
AS 2 C , 

calculating a camera pixel offset in the tilt direction, CPO(T), based on 
AT 2 C 

wherein PO(S) is determined based on IPO(S), APO(S), and CPO(S), and 
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wherein PO(T) is determined based on IPO(T), APO(T), and CPO(T). 

44. (New) The method of claim 1 , further comprising: 
receiving an indication of a user-specified image flow; and 

controlling the line-of-sight controller in accordance with the user-specified image 
flow so that the object moves relative to the display area. 

45. (New) The method of claim 13 wherein controlling the line-of-sight 
controller includes compensating for a user-specified image flow. 
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